regret base onlin rank grow digit librari erick delag common environ rank take specif form user sequenti gener queri digit librari queri rank appli order set relev item user select favorit case rank search result page world wide web merchand commerc site work present onlin rank algorithm call noregret klrank algorithm design clickthrough inform provid user improv futur rank decis importantli show long term averag perform converg rate achiev compet fix rank polici select benefit hindsight show ensur properti continu hold item ad set requir richer class rank polici final empir result show context noregret klrank consid conserv greedi variant algorithm outperform popular rank algorithm 